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Upload the images you want to use for your panorama 
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ff* 1^ <inc 

A<J<) | After the images are uploaded, 

click here! 
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Here is your free panoramic image! 




Click here to order a full resolution glossy print 



RECEIVE IMAGES OVER NETWORK 




1 




DETERMINE RELATIVE POSITIONS 






r 




CORRECT PERSPECTIVE DISTORTION 


10 if 









COMPUTE FOCAL LENGTH AND ANGLE FOR EACH IMAGE 


^ 
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MAP IMAGES TO CYLINDER 




r 




BLEND IMAGES 




r 



xo2 



STOP 
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CREATE EMPTY "POSITIONED LIST" STRUCTURE FOR 70^ 
STORING IMAGES WHOS RELATIVE POSiTON IS KNOWN 



DONE 




Fig.7A 




LIST 



SET 

REFERENCE = NEXT 

IMAGE AFTER 
REFERENCE IMAGE IN 
OVERLAP LIST 



YES 



CHECK IF 

ADJACENT LISTS INDICATE THAT CURRENT IMAGE IS 
^ECTED TO REFERENCED 



NO 



TRANSLATE CURRENT IMAGE AND ALL IMAGES CONNECTED TO IT 
RELATIVE TO THE REFERENCE IMAGE BASED ON THE OFFSETS OF 
THE REFERENCE AND CURRENT IMAGE TO THE UNPOSITIONED IMAGE 



APPEND THE UNPOSITIONED IMAgI AND THE -VE OP THE OFFSET OF U <- fe 
THE CURRENT IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO THE { > 
ADJACENT LIST OF THE CURRENT IMAGE | 




7£0 





YES 

r 








APPEND THE UNPOSITIONED IMAGE AND THE -VE OF THE OFFSET OF 
THE REFERENCE IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO 
THE ADJACENT LIST OF THE REFERENCE IMAGE 



SET 

CURRENT = NEXT IMAGE 
AFTER CURRENT IMAGE 
IN OVERLAP LIST 




TRANSLATE UNPOSITIONED IMAGE RELATfVE 
BEST CONFIDENCEJMAGE BASED ON THE OFFSET OF THE 
BEST CONFIDENCE IMAGE 



APPEND iMaGE-S IN OVERLAP LIST AND THEIR OFFSETS TO THE 
ADJACENT LIST OF THE UNPOSITIONED IMAGE 



ADD UNPOSITIONED IMAGE TO THE POSITIONED LIST 



7?0 



7?^ 



77y 



GO TO 7C>y (FIG 7A) 



Fig. 7« 



DETERMINE CENTERMOST IMAGE BASED ON RELATIVE 
POSITIONS 



CREATE LIST OF CORRECTED IMAGES THAT INCLUDES ONLY 
THE CENTERMOST IMAGE 



CREATE UST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 



INITIALIZE BY SETTING: 
MAX OVERLAP AREA=0 
SELECTED WARPEDJMAGE=UNDEFINED 
SELECTED UNWARPED JMAGE=UNDEFINED 



SET: 

CURRENT WARPED-FIRST IN IMAGE IN CORRECTED LIST 
CURRENT UNWARPED*F!RST IMAGE IN UNCORRECTED LIST 



COMPUTE OVERLAP AREA BETWEEN CURRENT WARPED AND 
CURRENTJJNWARPED 



gov 



$10 




CHANGE SELECTED IMAGES BY SETTING: 
MAX_OVERLAP_AREA»OVERLAP AREA 
SELECTED_WARPEDJMAGE»CURRENT WARPED 
SELECTED UNWARPED IMAGE»CURRENT UNWARPED 




SET CURRENT.WARPED = NEXT IMAGE IN UST OF 
CORRECTED IMAGES 

SET: 

CURRENT UNWARPED = NEXT IMAGE IN UST OF 
UNCORRECTED IMAGES 
CURRENT WARPED = FIRST IMAGE IN UST OF 
CORRECTED IMAGES 



DONE 



CORRECT THE PERSEPECTIVE OF££Utr€ xLUNWARPED 
RELATIVE TO UKT» WARPED BASED ON THEIR RELATIVE 
1 POSTIONS 



MOVE CURRENTJJNWARPED IMAGE FROM UST OF 
UNCORRECTED IMAGES TO LIST OF CORRECTED IMAGES 



Fig. 8 
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Original Image 





z-D cooruinaies 


4-D coordinates 


Vertex 0 


(x 0 , yo) 


(x 0 ,yo, 0,1)] 




Vertex 1 


(xi, yi) 


(xi,yi,0,l)( 




Vertex 2 


(X2, yi) 


(X2, y2, o, 1) 


Vertex 3 


(x3, y3) 


(x 3 ,y 3 , 0, 1) 




The i th vertex 


(x„ y.) 


(x„ yi, o, l) 





0 * 




Perspective Correction Transformations 



1. Translate outwards: 



1 0 0 0" 
0 10 0 
0 0 10 

oo/i 



2. Three rotations: 



0. = 



10 0 0 

0 cos (9, sin0 x 0 

0 -sin^ cos9 x 0 

0 0 0 1 



'cos0 y 0 -sin^ 0 



0 



sin#, 



1 0 
0 cos#„ 



0 
0 



y ~ y 
0 0 0 1 



■\4 



0. = 



cos9 I sm6 z 0 0 

-sin0 z cos# z 0 0 

0 0 10 

0 0 0 1 



3. Translate inwards: 



10 0 0 
0 10 0 
0 0 10 
0 0-/1 



4. Effect of focal length on Perspective: 



10 0 

0 1 0 

0 0 0 

0 0 0 



0 
0 

1/ 
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Perspective Correction 
Perspective Corrected Image Vertices given by: 

p, =p,T a ® ! Q y ® x T b P = [x„y l ,z l ,w l ] ^ 



But: 



J 



w = - ^ (- sin 0, sin 9 r + cos 6. sin 9 V cos 9 V ) + ^ (cos 9 Z sin 9 X + sin 9 Z sin 0, cos 9 X ) + cos 5 cos 9 X 

and Xi' and y\ from the perspective corrected image are given by: 



and y>%, 



Therefore we can write: 



Taking: 

^ ^ A 

We can write: 



-F(t) 



x.-F H (0 t ,e y ,e x ,f) 

y 0 -F yo (e 2 ,e y ,e x ,f) 



x,-F x (9 2 ,9 y ,9 x ,f) 
y,-F yi {9 z ,9 y ,9 x ,f) 



Newton's Method 

By Newton's method of numerical computation, t is an estimate of the values 

*„ *, A 

then: 

f„ -»-/-*<«> — 

is a better estimate of the values. 

Where J" 1 is the matrix of partial derivatives: 

dF. _ 



INITIALIZE FOCAL LENGTH AND ROTATION ANGLES 



COMPUTE COORDINATES OF VERTICES OF PERSPECTIVE DISTORTED 
IMAGE BASED ON FOCAL LENGHT AND ROTATION ANGLES 



(6-10 



COMPUTE ERROR BETWEEN COMPUTE COORDINATES OF VERTICES 
AND ACTUAL COORDINATES OF VERTICES FROM MANN METHOD 



I 



DETERMINE JACOBIAN MATRIX 



I 



MULTIPLY ERRORS WITH INVERSE OF JACOBIAN MATRIX TO 
DETERMINE CORRECTION TO ROTATION ANGLES AND FOCAL LENGTH 



UPDATE FOCAL LENGTH AND ROTATION ANGLES BASED ON 
CORRECTION 




Fig. 11 



1206 



SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE 



1208 



1210 



SET CURRENT IMAGE TO FIRST IMAGE 



SET CURRENT IMAGE TO NEXT AFTER CURRENT IMAGE AND REFERENCE IMAGE TO FIRST 

IMAGE 



1212 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY ALLIGNING THE CURRENT AND 
REFERENCE IMAGES BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 



1214 



DETERMINE LINE DIVIDING PANORAMIC OUTLINE (I.E., LONGEST LINE JOINING POINTS 
WWFRF RORnFRS OF PTfRRFNT TMAGF AND RFFFRFMPF TMAGF TNTFP^FCTt 



1216 



DIVIDE PANORAMIC OUTLINE INTO TWO SECTIONS BASED ON LINE 



1218 



DETERMINE WHICH OF THE TWO SECTIONS HAS LESS OF THE CURRENT IMAGE THAT IS NOT 
OVERLAPPED BY THE REFERENCE OUTLINE 



1220 



SET CURRENT IMAGE TO NOT BE INVISIBLE IN THE DETERMINED SECTION 




YES 



^ NO 



1226 



DETERMINE MASKING VALUE FOR EACH PIXEL OF CURRENT IMAGE BASED ON VISIBLE 

ARF A OP TMAPtF A1SJH PRCVIMITV TD niVTniMG T IXTPS 




1230 j NO 

OVERLAP IMAGES BASED ON MASKING VALUES TO CREATE A PANORAMIC IMAGE | 



1224 



SET REFERENCE TO 
NEXT IMAGE AFTER 
REFERENCE IMAGE 



Fig. 12 



( DONE ) 



